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Abstract 

Microbes providing public goods are widespread in nature despite running the risk 
of being exploited by free-riders. However, the precise ecological factors supporting 



["t'I cooperation are still puzzling. Following recent experiments, we consider the role 

• of population growth and the repetitive fragmentation of populations into new 

,.0 colonies mimicking simple microbial life-cycles. Individual-based modeling reveals 
I 

I ^^1 that demographic fluctuations, which lead to a large variance in the composition of 

1-H colonies, promote cooperation. Biased by population dynamics these fluctuations 
> 

C^ result in two qualitatively distinct regimes of robust cooperation under repetitive 

in 



fragmentation into groups. First, if the level of cooperation exceeds a threshold. 



C^ cooperators will take over the whole population. Second, cooperators can also 

o 

CN emerge from a single mutant leading to a robust coexistence between cooperators 

^ and free-riders. We find frequency and size of population bottlenecks, and growth 

/\ dynamics to be the major ecological factors determining the regimes and thereby 

the evolutionary pathway towards cooperation. 



One pivotal question in evolutionary biology is the emergence of cooperative traits and 



their sustainment in the presence of free-riders (Axelrod and Hamilton, 1981; Frank 1998 



Hamilton, [1964 [Maynard-Smith and Szathmary 1995 Nowak 2006 West and Gardner 



2010). By providing a public good, cooperative behavior of every single individual would 



be optimal for the entire population. However, non-contributing free-riders may take evo- 
lutionary advantage by saving the costs for providing the benefit and hence jeopardize the 



survival of the whole population. In evolutionary theory kin selection (Foster et al. , 2006 



Hamilton, 1964 Michod 1982; West et al. 2007), multi-level selection (Hamilton 1975 



Nowak et al. 2010; Okasha, 2006 Wilson 1975), and reciprocity (Trivers 1971) have been 



found to provide conceptual frameworks to resolve the dilemma (Frank, 1998; Nowak, 2006 



West and Gardner, 2010). For higher developed organisms, stable cooperation is generally 



traced back to specific mechanisms like repeated interaction (Axelrod and Hamilton, 1981 



Trivers 1971), punishment (Fehr and Fischbacher 2003; Yamagishi 1986), and kin discrim 



ination (Hamilton, 1964 Queller et al. 2003 West and Gardner, 2010 West et al., 2006) 



But how can cooperation emerge in the first place and be maintained without abilities like 
memory or recognition? Answering this question is especially important within the ex- 



panding field of biofilm formation (Keller and Surette 2006 Nadell et al. , 2009 Rainey and 



Rainey 2003 Stewart and Franklin, 2008 Velicer 2003 Xavier, 2011). There, a successfully 



cooperating collective of microbes runs the risk to be undermined by non-producing strains 



saving the metabolically costly supply of biofilm formation (Nadell et al. , 2009 Velicer 



2003 West et al. , 2006 Xavier, 2011). Sophisticated social behavior cannot be presumed 



to explain the high level of cooperation observed in nature and experiments (Ackermann 



eTaLj [20081 [Buckhng et aL] |2007t [Chuang et al.j |20T0l [20091 l<^ore et all [2009| [Griffin et al. 



20041 [Kiimmerh efall [20091 [Rainey and Raineyj [2003| [Vehcerj [20031 [West et all [2006 



Xavier, 2011). Instead, different forms of limited dispersal, such as spatial arrangements. 



or fragmentation into groups are essential to resolve the dilemma of cooperation among 



such microbial organisms (Hamilton 1964 Maynard Smith 1964 Nowak and May 1992) 



Indeed, in nature microbes typically life in colonies and biofilms. Remarkable, although 
details strongly differ from species to species, most microbial populations follow a life cycle 
of colony initiation, maturation, maintenance and dispersal leading to new initiation, see 



e.g. (Costerton et al. 1987; Hall-Stoodley et al. 2004 McDougald et al. 2011 O'Toole 



et al. , 2000 Xavier, 2011). Well-studied examples include Pseudomonas aeruginosa (Sauer 



et al. , 2002), Escherichia coli (Beloin et al. , 2008), Bacillus subtilis {Leraon et al. , 2008) and 



Myxococcus xanthus (Velicer and Vos, 2009). Even though such a hfe-cycle is often com- 



plexly regulated e.g. by environmental impacts and including collective behavior of colonies, 
populations bottlenecks alternating with growth phases are essential components of most 
microbial life-cycles. Employing simplified setups, recent experiments address the role of 
population bottlenecks and growth by studying structured microbial populations of cooper- 



ators and free-riders (Buckling et al. 2007 Chuang et al., 2010 2009; Griffin et al. 2004 



Kiimmerli et al. , 2009). In these setups small founder colonies differing in composition were 



cultivated in separate habitats. For example, Chuang et al. (Chuang et al. , 2009) used 96 



well plates as structured environment with a dilution of synthetically designed E.coli strains 
where the cooperative strain is producer of a public good provoking antibiotic resistance. 
A microbial life-cycle was generated in the lab by regularly mixing all colonies after a cer- 
tain time and inoculating new cultures. Under these conditions, an increase in the overall 
level of cooperation was observed even though free-riders have a growth advantage within 
every colony. However, the precise conditions under which cooperation is favored are sub- 



tle (Chuang et al., 2010 Foster et al., 2006; Killingback et al., 2006; Maynard Smith, 1964 



Motroj pMTj INowak et"al| [20T0| [Pfeiffer et al.] [200H [Szathmary and Demerterj \\Mi\ [Sza 
thmaryj p^93l [Traulsenl [20091 ITraulsen and Nowakj [20061 [West et aLj [20071 IWilsonj [T975 



Wilson and Wilson, 2007). A possible theoretical explanation for the observed increase in 



cooperation is the antagonism between two levels of selection, as widely discussed in the 



literature (Okasha, 2006). Here, these levels, intra- and inter-group evolution, arise as pop- 



ulation dynamics alternates between independent evolution in subpopulations (groups) and 
global competition in a merged well-mixed population. Due to the dilemma of cooperation, 
free-riders are always better off than cooperators within each group (intra-group evolution). 
In contrast, on the inter-group level, groups with a higher fraction of cooperators are favored 
over groups with a lower one. 

In this article, we study the interplay between the dynamics at the intra- and inter-group 
evolution and how it may provoke the maintenance or even the emergence of cooperation. We 
propose a generic individual-based model which includes three essential elements: a growth 
disadvantage of cooperators within each group, an advantage of groups incorporating more 
cooperative individuals, and regularly occurring regrouping events; cf. Fig. [1} Well-known 



from the theories of kin (Hamilton 1964; Michod 1982; Traulsen, 2009 West et al. 2007) 



and multi-level selection (Chuang et al. 2009; Okasha 2006; Price 1970; Traulsen 2009), 



cooperation can increase in principle: While, within a group i, the fraction of cooperators, ^j, 
decreases, groups also change their size, Ui, such that the fraction of cooperators in the total 
population, given by the weighted average, x = ^^ Ui ^t / ^^ Ui, may still increase. Such an 
increase is an example of Simpson's paradox (Chuang et al., [2009 ). To occur, a decreasing 
fraction of cooperators, ^j, within groups must be compensated by changing weights, I'i/N, in 
the total population of size A^ = Yli ^ii i-^- by a sufficiently high positive correlation between 



a group's size and its fraction of cooperators (Price , 1970 ). Here we want to go beyond stating 



this mathematical fact and reveal the ecological factors underlying these correlations. To 
this end the full stochastic dynamics at the intra- and inter-group level will be analyzed. A 
key element will be the intricate coupling between the dynamics of the composition and the 
dynamics of the overall size of a group. This applies in particular to microbial populations 
where the reproduction rate of microbes strongly depends on environmental conditions and 



thereby also on the composition of the population (Monod 1949). Therefore, a proper 



theoretical formulation has to account for a dynamics in the group size (Cremer et al. , 2011 



Melbinger et al. , 2010) rather than assuming it to be constant as in most classical approaches 



(Fisher 1930; Moran 1964 Wright 1931). Such a dynamic formulation will allow us to 



investigate ecological mechanisms for the evolution and maintenance of cooperation. 



Motivated by microbial hfe-cycles (Costerton et al. 1987; Hall-Stoodley et al. 2004 



McDougald et al. 2011; O'Toole et al. 2000; Xavier 2011) and the aforementioned experi 



ments (Buckhng et al. 2007 Chuang et al. 2010, 2009 Griffin et al. 2004 Kiimmerh et al 



2009), we consider a population of cooperators and free-riders and its evolution in a repet- 



itive cycle consisting of three consecutive steps (Maynard Smith, 1964), cf. Fig. 11} In the 
group formation step, the total population with a fraction of cooperators, xq, is divided into 
a set of M groups by an unbiased stochastic process such that the group size and the fraction 
of cooperation vary statistically with mean values uq and Xq, respectively. Subsequently, the 
groups evolve independently [group evolution step). In each group, both the fraction of 
cooperators and the group size vary dynamically and change over time. Independent of the 
specific details, the groups' internal dynamics has the following characteristic features: First, 
because of the costs for providing the benefit, cooperators have a selection disadvantage, s, 
compared to cheaters in the same group. In particular, cooperators reproduce slower than 
cheaters and hence the fraction of cooperators decreases within each group (intra-group 
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Figure 1 Repetitive cycle of population dynamics. The time evolution of a population composed of coop- 
erators (blue) and free-riders (red) consists of three cyclically recurring steps. Group formation step: we 
consider a well- mixed population which is divided into M separate groups {i — 1, . • . , M) by an unbiased 
stochastic process such that the initial group size and the fraction of cooperation vary statistically with mean 
values riQ and xq, respectively. Group evolution step: groups grow and evolve separately and independently; 
while the fraction of cooperators decrease within each group, cooperative groups grow faster and can reach 
a higher carrying capacity. Group merging step: after a regrouping time, T, all groups are merged together 
again. With the ensuing new composition of the total population, the cycle starts anew. 



evolution). Second, considering the benefit of cooperation, groups witli more cooperators 
grow faster and can reacli a liiglier maximum size (carrying capacity) than groups of mainly 
cheaters (inter-group evolution) ( [Cremer et al. 201 1[ [Melbinger et al. , 2010); this advantage 
scales with a parameter, p. These general features can be given a precise mathematical 
form: Groups follow logistic growth with growth rate and maximum size depending on the 
fraction of cooperators. For specificity we assume growth conditions comparable to those 



observed by Chuang et al. (Chuang et al. , 2009). Details are given in the materials and 



method section and the supplementary information. After evolving separately for a certain 
time t = T, all groups are merged {group merging), and the cycle restarts by forming new 
groups according to the current fraction of cooperators, x, in the whole population. It is 
the interplay of these three steps, characterized by the initial group size, no, the selection 
strength, s, and the regrouping time, T, which determines the long-term evolution of the 
population. 



Results 



Fig. |2]A shows the time evolution of the overall fraction of cooperators during a group 
evolution step. We find three distinct scenarios: decrease (red), transient increase (green), 
and permanent increase of cooperation (blue). Their origin can be ascribed to two ecological 
mechanisms: more cooperative groups grow faster {group- growth mechanism) and purely 
cooperative groups can reach a larger carrying capacity {group-fixation mechanism) . 

A permanent increase of cooperation can be explained on the basis of the group-fixation 
mechanism: for asymptotically long times the intra-group evolution reaches a stationary 
state, where each group consist solely of either cooperators or free-riders. Which state is 
favored depends on the interplay between selection pressure and stochastic effects. Because 
cheaters have a relative fitness advantage, they tend to outcompete cooperators in groups 
with a mixed initial composition. However, there are two stochastic effects leading to purely 
cooperative groups. First, the stochastic process of group formation results in a distribution 
of group compositions also containing a fraction of groups which consist of cooperators only. 



Second, random drift (Cremer et al. , 2009; Kimura, 1983), which is most pronounced during 



a population bottleneck where group sizes are small, can cause a group to become fixed in 
a state with cooperators only. Due to the benefit of cooperators for the whole group, these 
purely cooperative groups reach a much higher carrying capacity than those left without 
any cooperator. Hence, although inferior in terms of number of groups, purely cooperative 
groups through their large group size contribute with a large statistical weight to the total 
composition of the population, and thereby ensure maintenance or even increase of the level 
of cooperation for long times, cf. Fig. [2]A. blue curve. 

In order for the group-fixation mechanism to become effective the evolutionary dynamics 
has to act for time scales longer than the selection time, ts '■= 1/s, which measures the time 
scale on which selection acts. For smaller times, a temporary increase in cooperation level is 
observed provided the initial group size is small enough, cf. Fig. |2]A. The initial rise is caused 
by the group-growth mechanism during the growth phase of colonies, see Fig. |2]C. Given a 
distribution of initial group compositions, it asymmetrically amplifies the size of those groups 
which contain more cooperators. This effect becomes stronger with a broader distribution, 
or, equivalently, a smaller initial group size uq. Eventually the initial rise has to decline since, 
due to the internal selection advantage of free-riders, the fraction of cooperators is always 




Figure 2 Evolution while individuals are arranged in groups (group-evolution step). A Population average 
of cooperator fraction, a;, as a function of time t. Depending on the average initial group size, no, three 
different scenarios arise: decrease of cooperation (red line, tiq = 30), transient increase of cooperation (green 
line, no = 6, increase until cooperation time tc) and permanently enhanced cooperation (blue line, no = 4). 
These three scenarios arise from the interplay of two mechanisms. While the group- growth mechanism, due 
to faster growth of more cooperative groups, can cause a maximum in the fraction of cooperators for short 
times, the group-fixation mechanism, due to a larger maximum size of purely cooperative groups, assures 
cooperation for large times. Both mechanisms become less efficient with increasing initial group sizes and 
are not effective in the deterministic limit (dashed black line, solution of Eq. S7). B The strength of the 
group-growth mechanism decreases with an increasing initial fraction of cooperators. This is illustrated by 
comparing the time evolution for three different initial fractions of cooperators and a fixed initial group 
size no — 5. After a fixed time, here t = 3.03, the fraction of cooperators is larger than the initial one 
for xq — 0.2, equal to it for xq — 0.5, and eventually becomes smaller than the initial value, as shown 
for Xq = 0.8. C Change of the average group size, n = J2i '^i/M. At the beginning the groups grow 
exponentially, while they later saturate to their maximum group size. As this maximum size depends on 
the fraction of cooperators, the average group size declines with the loss in the level of cooperation (no — 6, 
green line). The deterministic solution (dashed black line) describes this behavior qualitatively, s ~ 0.1, 
p= 10. 



decreasing within each mixed group. As a consequence, the overall benefit of cooperators 
through faster growth of more cooperative groups is only transient. After a certain time, 
the cooperation time, t^, the fraction of cooperators, x{t), falls again below its initial value, 
Xq, unless the group-fixation mechanism is strong enough to ensure a permanent increase. 
Finally, if group-internal selection is too strong compared with the growth advantage of 
cooperative groups, the level of cooperation cannot increase even transiently, cf. Fig. [2]A., 



red curve. 

Combining all three steps of the cycle we now ask for the evolutionary outcome after 
many iterations, k, of the cycle. For very small bottlenecks, hq < 3, both the group-fixation 
and the group-growth mechanism result in a a purely cooperative population and cannot be 
distinguished. This is shown in Fig. ISlA. for parameters corresponding to the experiments 



by Chuang et al. (Chuang et al. , 2009); the experimental results and the results of our 
stochastic model are in excellent agreement. For larger bottlenecks, uq = 5, and depending 
on the relative magnitude of the regrouping time T, we find two fundamentally distinct 
scenarios, see Fig. [3^. For large regrouping times, T ^ tg, there is a threshold value, 
X*, for the initial cooperator fraction, xq, above which cooperators take over the whole 
population and below which they go extinct. In contrast, for regrouping times smaller than 
the selection time, T < tg, independent of the initial value, xq, the population reaches a 
stationary state where cooperators are in stable coexistence with free-riders. As explained 
next, these two scenarios are closely tied to the group-growth and group- fixation mechanisms; 
for an illustration see the supplementary videos. The threshold value for maintenance of 
cooperation at large regrouping times is a consequence of group-fixation and the larger 
carrying capacity of purely cooperative groups. Since for T ^ ts the intra-group dynamics 
has reached a stationary state, fixation leaves the population with groups consisting of either 
cooperators or defectors only. The probability of fixation in the respective state and hence 
the fraction of purely cooperative groups after completing one cycle strongly depends on 
the initial cooperator fraction. Now, if the initial cooperator fraction becomes too low, the 
number of cooperative groups will be too rare such that even their larger maximum group 
size is no longer sufficient for them to gain significant weight in the total population, and 
the overall cooperator fraction in the population will decline. Thus there must be a critical 
value for the cooperator fraction, x*, below which, upon iterating the cycle the fraction 
of cooperators will decline more and more, see Fig. IslB (red line). In contrast, above the 
critical value purely cooperating groups are becoming more frequent upon regrouping, and 
therefore cooperators will eventually take over the population completely, cf. Fig. [3^ (blue 
line) . 

When groups are merged during the phase of transient increase of cooperation, T < ts, 
the stationary level of cooperation does not depend on the initial one. This behavior is due 
to the dependence of the change of the cooperator fraction during one cycle. Ax, on the 
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Figure 3 Evolution of the overall cooperator fraction under repeated regrouping. After many iterations, fc, 
of the evolutionary cycle, a stationary level of cooperation is reached. A For small population bottlenecks, 
"■0 ^ 3i group-growth and group- fixation mechanisms are effective and lead to purely cooperative popula- 
tions. Growth parameters, bottleneck size and the regrouping time are chosen according to the experiments 



by Chuang et al. (Chuang et al. 2009), see supplementary information. Without any fitting parameters, our 



simulation results (colored lines) are in good agreement with the experimental data (black points). B For 
larger bottlenecks, uq ~ 5, and depending on the relative efficiency of the group-growth and group-fixation 
mechanism, two qualitatively different regimes can be distinguished. While the group-growth mechanism 
leads to stable coexistence of cooperators and free-riders (green lines), the group-fixation mechanism can lead 
to a pure state of either only cheaters (red line) or only cooperators (blue line) . The relative impact of these 
mechanisms depends strongly on the regrouping time T. For short regrouping times (Tghort = 2.5 < ts, green 
lines), the group-growth mechanism is effective, while for sufficiently long regrouping times (Tiong = 20 > i^, 
blue and red lines) the group-fixation mechanism acts more strongly. C With parameters equal to B, the 
detailed interplay of the group-growth and group-fixation mechanisms is summarized in a bifurcation dia- 
gram showing the stationary levels of cooperation as a function of the regrouping time T. Depending of the 
relative efficiency of both mechanism, four different regimes arise: pure cooperation, coexistence, interme- 
diate, and bistability. The times T^hort a-nd Tiong correspond to the green and red/blue lines shown in B. 
Parameters are xq — 0.086, T = 3.f , s = 0.05 and p — 6.6 in A; see also supplementary information. In B, 
xq = {0.1 (green), xq ~ 0.9 (green)} and xq = {0.5 (red),xo — 0.6 (blue)} for Tghort = 2.5 and Tiong — 20, 
respectively, s = 0.1 and p=10inB/C. 



initial fraction, xq as discussed in the following; see also Fig. [2p. As we have already eluded 
to in the discussion of the group-growth mechanism, stochasticity during group formation 
and during the initial neutral phase of the group evolution dynamics results in a broad dis- 
tribution of group compositions. The evolutionary dynamics is acting on this distribution in 
an antagonistic fashion. While, due to the higher growth rate of more cooperative groups, 
the distribution develops a positive skew leading to an increase in the average overall co- 
operation, the group-internal selection pressure is counteracting this effect by reducing the 
cooperator fraction within each group. The relative strength of the former effect is largest 
for small initial cooperator fraction since this allows the largest positive skew to develop. 
Hence, for a given regrouping time, if the change in overall cooperator fraction Ax is posi- 
tive for small xq it must become negative for sufficiently large xq, as illustrated in Fig. |2^. 
For a more detailed mathematical discussion of these effects we refer to the supplementary 
information. As a consequence, in populations with a small initial fraction of defectors, the 
defectors increase in frequency. At the same time, when the initial fraction of cooperators 
is low, they also increase in number, finally leading to stable coexistence of cooperators and 
defectors at some fraction x*. This stationary fraction of cooperators is independent of the 
starting fraction and solely determined by the parameters of the evolutionary dynamics. 

The interplay of both the group-growth and group-fixation mechanism leads, depending 
on the regrouping time, to different scenarios for the levels of cooperation. These are sum- 
marized in the bifurcation diagram Fig. [3p, where the stable and unstable fixed points of 
the regrouping dynamics, x* and x*, are shown as functions of the regrouping time. The 
scenarios can be classified according to their stability behavior under regrouping as follows: 
For large regrouping times, T ^ ts, the group-fixation mechanism leads to bistable behavior. 
With decreasing T, the fixation mechanism loses ground while the group-growth mechanism 
becomes more prominent. There is a intermediate scenario: the dynamics is bistable with 
full cooperation as well as coexistence as stable fixed points. For even smaller times, only the 
group-growth mechanism remains effective and the rare strategy here always outperforms 
the common one such that each strategy can invade but not overtake the other: coexistence. 
Finally, for T <^ts, cooperators always take over the population, effectively leading to purely 
cooperative populations. 
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Discussion 

In this article, we have studied the influence of population dynamics and fluctuations 
on the evolution and maintenance of cooperation. We specifically account for alternating 
population bottlenecks and phases of microbial growth. Thereby, our model serves as a 



null- model for cooperation in rearranging populations (Buckling et al. 2007; Chuang et al. 



2010 2009 Griffin et al. , 2004; Kiimmerli et al. , 2009), e.g. during microbial and parasitic 



life-cycles (Dronamraju and Arese 2006 Strassmann et al. 2000 Velicer and Vos, 2009 



Wilson 1977 Xavier 2011), and bacterial bioffim formation (Costerton et al. 1987 Hall- 



Stoodley et al., 2004; McDougald et al. 2011; O'Toole et al, 2000 Xavier 2011). The 



final outcome of the dynamics depends on the interplay between the time evolution of size 
and composition of each subpopulation. While a growth advantage of more cooperative 
groups favors cooperators, it is counteracted by the evolutionary advantage of free-riders 
within each subpopulation. We have investigated the stochastic population dynamics and 
the ensuing correlations between these two opposing factors. Depending on whether groups 
are merged while they are still exponentially growing or already in the stationary phase, 
two qualitatively different mechanisms are favored, the group-growth and the group-fixation 
mechanism. Importantly, our analysis identifies demographic noise as one of the main de- 
terminants for both mechanisms. First, demographic noise during population bottlenecks 
creates a broad distribution in the relative abundance of cooperators and free-riders within 
the set of subpopulations. The growth advantage of more cooperative subpopulations implies 
an asymmetric amplification of fluctuations and possibly yields to an increase of coopera- 
tion in the whole population (group-growth mechanism). Our analysis shows that this can 
enable a single cooperative mutant to spread in the population which then, mediated by the 
dynamics, reaches a stationary state with coexisting cooperators and free-riders. Second, if 
the founder populations contain only very few individuals, demographic fluctuations strongly 
enhance the fixation probability of each subpopulation which then consists of cooperators 
or free-riders only. Purely cooperative groups can reach a much higher carrying capacity. 
However, only if the relative weight of purely cooperative groups is large enough, this ef- 
fect leads to an increase in the level of cooperation in the whole population (group-fixation 
mechanism). From our theoretical analysis of the population dynamics we conclude this to 
be the case only if the initial fraction of cooperators is above some threshold value. 
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As shown by comparison with experiments by Chuang et ah (Chuang et al. , 2009) the 



proposed model is able to describe microbial dynamics quantitatively. Moreover, our model 
makes predictions how the evolutionary outcome varies depending on population dynamics 
and bottlenecks, and how the discussed mechanisms can provoke cooperation. These pre- 
dictions can be tested experimentally by new experiments similar to those of Chuang et al. 



and others (Buckling et al., 2007 Chuang et al. 2010 2009 Griffin et al. 2004 Kiimmerh 



et al. , 2009): For example, by varying easily accessible parameters like the bottleneck size 



hq or the regrouping time T, the relative influence of both mechanisms can be tuned. Then 
the resulting level of cooperation and the ensuing bifurcation diagrams can be quantitatively 
compared with our theoretical predictions. 

As we assume the worst case scenario for cooperators, e.g randomly formed groups and no 
additional assortment, our findings are robust: The discussed pathways towards cooperation 
based on a growth-advantage of more cooperative groups and restructuring are expected to 
stay effective when accounting also for other biological factors like positive assortment, 
spatial arrangements of groups, mutation, or migration^. 

Shown by our analysis, a regular life-cycle favors cooperation. Besides better nutrient 
exploitation, this advantage for cooperation might be one reason for the evolution of more 
complex, controlled life-cycles including collective motion of microbes, local lysis, and sporu- 



lation (Costerton et al. 1987 Hall-Stoodley et al. 2004 McDougald et al., 2011 O'Toole 



et al. 2000 Xavier, 2011). 



Methods 

We used a stochastic, individual-based model where each individual is either a cooperator 
or a free-rider. In the group formation step groups are formed at random. The initial group 
size, z/o,j, is Poisson distributed (with mean no). Given this size, the fraction of cooperators 
.^0,1 follows by a binomial distributed number of cooperators. During the evolution step, each 
individual is subject to random birth and death events. The dynamics is given by a time- 
continuos Markov process where the change of the probability, dtP{i'i,C,i]t), is given by a 
master equation. In detail, the basal per capita birth rate of each individual depends linearly 



^ publication in preparation 
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on the group level of cooperation ^j, while the per capita death rate increases linearly with 
the group size z/j the individual belong to. In addition, free-riding individuals have a higher 
birth-rate where the strength of selection s measures the advantage of free-riding individuals. 
Full details are given in the supplementary information. The time scale is such that a small 
population of only free-riders initially grows exponentially with the average size Ui^expt. 
To investigate the dynamics and both evolutionary mechanisms we performed extensive 



computer simulations by employing the Gillespie algorithm (Gillespie, 1976). Group size is 
M = 5 ■ lOMn Fig. 2, and M = 5 ■ 10^ in Fig. 3. 
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In this supplementary text, we give a more detailed discussion of our model and the group- 
growth mechanism. Furthermore we show comparisons of our analysis with experiments by 



Chuang et al. (Chuang et al. 2009). 



I. THE MODEL 

Here, we give details on the consecutive steps of the "life-cycle" of the meta-population. 
We first specify the group formation step before considering the dynamics within groups 
(group evolution step). 

A. The Group Formation Step 

Starting with an initial fraction of cooperators xq in the population, M groups are formed. 
Both, group size and group composition, are randomly distributed. Each group i G [1, M] 
initially consists of z/o,i individuals. If the population from which the groups are formed is 
much larger than Muq, Uqi follows a Poisson distribution^, 

h 



P{uo,^) = ^exp{-no), (SI) 



This holds for typical conditions of small population bottlenecks as observed in bacterial life-cycles. 
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with mean hq. Further, the initial composition of each group is also formed randomly. The 
probability for (q^ j cooperators in a group i is assumed to be given by a Binomial distribution 

with mean Xoi^o,!- The initial fraction of cooperators i^o, j within each group is thereby given 

By this we assume the groups to be formed at random without any bias. This corresponds 
to a worst case scenario for cooperators which gain no additional advantage due to positive 
assortment. Note, that the same initial distribution of group compositions is reached if 
one assumes both, the initial number of cooperators (C) and free-riders (F), to be Poisson 
distributed with mean values Ac and Xp, respectively. The mean values are related by 
no = Xc + Xp and xq = Xc/{Xc + A^). 

B. The Group Evolution Step 

After the groups were formed randomly, they grow and evolve separately. In the follow- 
ing, we consider the dynamics within one specific group i in detail. As emphasized in the 
main text, we include two essential requirements experiments on microbial systems have in 
common. First, in each group cooperators (C) grow slower than free-riders {F). Second, 
groups with a higher fraction of cooperators grow faster and are bounded by a higher maxi- 
mum group size (carrying capacity) than groups with a lower one. To account for these facts. 



the growth rates have to consist of a group related and a trait /type specific part (Cremer 



et al. , 2011 Melbinger et al.l 2010). We, therefore, denote the per capita growth rate of an 



individual of type S G {C, F} within group i as 

^5(6)=^^)^, (S3) 

where g{ii) is the group related, fsi^i), S G {C,F} is the species related part, and 
(/) = 6/c(6) + (1 ~ 6)/F(^i) is the average fitness. The normalization of the fitness, 
fs{^i)/{f), is a convenient choice to disentangle the influence of global and relative parts 
more easily. Further, the group related part, g{C,i), which accounts for the growth advantage 
of more cooperative groups, is assumed to increase linearly with C,i- For specificity, we use 



experimental conditions similar to those presented in reference (Chuang et al. , 2010, 2009) 
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In these experiments, a purely cooperating population growth to an about ten times higher 
population size than a purely defecting one. In our model, the maximum population size 
scales with g and therefore we set 



g{ii)=r{l+pii). 



(S4) 



Here r determines the overall time scale for growth and defines our units of time, i.e. it is 
set to one unless specified otherwise. In the main text we have used p = 10 for specificity; 



see also section III where we compare with the experimental data by Chuang et a. (Chuang 



et al. 2009). 



Note, however, that the qualitative findings, especially both evolutionary mechanisms, 
do not depend on the exact form of g{^i) but only on the fact that g{^i) is monotonically 
increasing with the fraction of cooperators. The trait specific part, fs{C,i), includes the 
different growth rates of cooperators and free-riders within group i. We here employ the 
standard formulation of evolutionary game theory and assume it to be given by the payoff 



matrix of a Prisoner's dilemma game (Hofbauer and Sigmund, 1998 Nowak et al. , 2004) 
The trait specific parts are given by 



/c(6) =1 + s H, - c] , 



(S5) 



and the fitness advantage of free-riders A/ = fpix) — fc{x) = —sc is frequency indepen- 
dent. For specificity, we set 6 = 3 and c = 1. Thereby, the selection strength s is the only 
free parameter controlling the fitness difference. A/, which corresponds to the advantage 



of free-riders within each group. In the experiments (Chuang et al. , 2010, 2009), the selec 



tion strength was of the order s ~ 0.05. In our manuscript, we set s = 0.1 as an upper 
approximation of this value. 

To model growth bounded by restricted resources we further introduce per capita death 
rates which increase linearly with the number of individuals in a group. 



Ds{l^^) = ^- (S6) 

These are independent of the specific type S and lead to logistic-like growth within each 



group. K sets the scale of the maximum group size (Verhulst, 1838). In detail, for purely 



defecting groups the carrying capacity is K while it is (1 + 10) i^ for purely cooperating 
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ones. For the discussed results, only the ratio of group sizes and not their absolute values 
are important. Hence, for numerical convenience, we set K to a constant value, K = 100. 
The full stochastic dynamics follows a master equation which can be derived by the 



per capita growth and death rates, Eqs. (S3) and (S6). This master equation gives the 



temporal evolution of P{C,i] Vi'-, t), the probability for group i to consist of z/j individuals with 
a fraction of ^j cooperators at time t. We use the Gillespie algorithm to perform stochastic 



simulations (Gillespie 1976). 



While fluctuations strongly affect the dynamics, it is still instructive to look at the deter- 
ministic description where fluctuations during the group-evolution step are neglected. This 
deterministic dynamics within each group, i, is then given by rate equations for the fraction 
of cooperators ^i and the total group size Ui: 

dt^, = -s(i + ioe,)e,(i-e,), 

dtUi = (1 + Mi - Ui/K)ui. (S7) 

Thus, in a deterministic manner, intra-group evolution is described by a replicator-like 
dynamics while the size of each group follows logistic growth (with a C,i dependent growth 
rate and carrying capacity). We illustrate this dynamics in Fig. ^S4|for three different initial 
conditions. 

II. THE GROUP-GROWTH MECHANISM 

As stated in the main text, the group-growth mechanism relies on the faster growth of 
more cooperative groups. Even though cooperators reproduce slower compared to free-riders 
in the same group, the positive effect on group-growth can outbalance this disadvantage. 



For an illustration, see the speciflc example given in Table SI 

Here, we quantify the growth advantage of more cooperative groups. For this, we consider 
only short times t ^ 1/s. Then, and in the limit of weak selection, s <^ 1, the deterministic 



time evolution, given by Eqs. (S7), is 



Vi =z/o,iexp[5f(^o,i)i^]- 
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Figure S4 Dynamics in single groups. A Evolution of cooperation. For a mixed group (green), the 
fraction of cooperators declines due to the fitness advantage of free-riders while it stays constant 
for purely cooperating (blue) or defecting (red) groups. B Logistic like growth of the group size. 
For pure groups, the group-related advantage of more cooperative groups is most visible. Purely 
cooperating groups (blue) grow faster and reach a larger maximum carrying capacity than groups 
of only free-riders (red). A mixed group (green) grows faster than a group of only free- riders at 
the beginning. However also in the initially mixed group only free-riders can remain in the long 
run, and the carrying capacities of both groups become the same. The simulation average over 
different realizations of only one group. Parameters are no = 6 and s = 0.1, ^o is equal to (red), 
0.5 (green), and 1 (blue). 

TABLE SI Per capita growth rates of cooperators and free-riders in two groups 





group 1 


group 2 


fraction of cooperators S,i 


3/4 


1/4 


per capita growth rate cooperators, g{^i)fc{^i)/{f) 


8.31 


3.33 


per capita growth rate free-riders, g{Ci)fF{^i)/{f) 


9.05 


3.58 



Two groups, i = 1 and i = 2 in comparison. While the per capita growth rates of cooperators are 
smaller than the per capita growth rates of free-riders within every group, the per capita growth 
rate of cooperators in the more cooperative group 1 strongly exceeds the per capita growth rate 
of free-riders in the less cooperative group 2 due to the group related fitness g{S,i)- The strength 

of selection is given by s = 0.1. 
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Figure S5 How the group-growth mechanism depends on the fraction of cooperators. Two sets of 
two groups are compared, one with a low fraction of cooperators (bottom) and one with a high 
one (top). Both groups evolve for a certain time, here with (7 ex 1 + 3x and no selection advantage 
for free-riders, s = 0. As can be readily seen, the change in the fraction of cooperators is larger for 
groups with a smaller initial fraction of cooperators. 

The overall fraction of cooperators can be calculated by averaging over all possible initial 
group compositions. 

By differentiating with respect to time t, we find the following expression 

d 



dt 



X = Cov{x, g{x)). 



(S8) 



This corresponds to a Price equation on the group level (Okasha 2006 Price, 1970), here 



stating that an increase in the fraction of cooperators is possible in principle if there is a 
positive correlation between x and the group related growth g{x). However, for longer times 
t > 1/s the selection advantage of free-riders counteracts the group-growth mechanism such 
that it can only act transiently. 

As shown in the main text, the strength of the group- growth mechanism depends strongly 



on the initial fraction of cooperators. This is illustrated in Fig. ^ S5 
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III. COMPARISON WITH EXPERIMENTS ON SYNTHETIC MICROBIAL SYS- 
TEM BY CHUANG, RIVOIRE AND LEIBLER 

We have compared our theoretical analysis with recent experiments by Chuang et al. 



(Chuang et al. , 2009) on a synthetic microbial model system. They have studied regrouping 
populations with initial population size uq in the range between 2 and 3, an initial cooperator 
fraction of Xq = 0.086, and a regrouping time T = 12 — 13 h. Other model parameters were 
estimated as follows. The inherent fitness advantage of free-riders relative to cooperators 
was observed to be in the range between 1.04 and 1.05. In our model this translates to 

/c = 1 , (S9) 

Id = 1.05, (SIO) 



where in contrast to equation (S3) we did not normalize the species related part, i.e. (/) = 1. 



The growth curves for different compositions of the population (see Fig. S3 in (Chuang et al 



2009)) give access to the overall growth rate and its frequency dependence. From Fig. S3 in 



(Chuang et al. , 2009) we estimate: 

r = 6.8 X 10-^min-\ (Sll) 

j9 = 6.6. (S12) 

Employing these parameters in our model we have simulated the regrouping dynamics and 



find good agreement with the experimental results, cf. Fig. [S6p .. Since the population 
dynamics is still within the exponential growth phase at the regrouping time, we interpret 
the observed increase of cooperation as a group-growth mechanism. However, because of 
the particular set of experimental parameters, the resulting stationary cooperator fraction 
is very close to one which makes it difficult to observe coexistence between cooperators and 
free-riders. We can now use our theoretical model to explore the effects of an increase in the 
regrouping time. Changing the regrouping time from T = 12.5 h to T = 375 h we find that 
the time evolution of the cooperator fraction remains qualitatively similar, despite the fact 
that now cooperation increases because of the group-fixation mechanism, cf. Fig. |S6|3. Thus 
even by changing the regrouping time these small values of uq do not allow to distinguish 
between the two mechanisms. However, as discussed in the main text, larger values of no 
(in the range of 4 — 6) give a clear signature of each of the mechanisms upon varying the 
regrouping time. 
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Figure S6 Increase in the level of cooperation for conditions resembling those examined by Chuang 
et al. ( [Chuang et al.[ 2009). A Short regrouping time, T = 12.5/i. The measurements by Chuang et 
al. (black points) in comparison with the predictions of our model. Solid lines denote the expected 
level of cooperation. The dashed lines show the corresponding mean plus/minus the standard 
deviation. B, Large regrouping time T = 375/i. For similar conditions, but a longer regrouping 
time, the outcome is qualitatively the same and only cooperators prevail. For both parts of the 
figure parameters are xq = 0.086, r = 6.8 x lO^^min^^, fc = 1, /d = 1-05, p = 6.6. In A, 
K = 1.5x 10^. InB, K = 1.5 x 10^. 



References 

J S Chuang, O Rivoire, and S Leibler. Cooperation and Hamilton's rule in a simple synthetic 

microbial system. Molec. Syst. Biol, 6:398, 2010. 
J S Chuang, O Rivoire, and S Leibler. Simpson's paradox in a synthetic microbial system. Science, 

323(5911):272-275, 2009. 
J Cremer, A Melbinger, and E Frey. Evolutionary and population dynamics: A coupled approach. 

Phys. Rev. E, 84:051921, Nov 2011. 
D Gillespie. A general method for numerically simulating the stochastic time evolution of coupled 

chemical reactions. Journal of Computational Physics, 22(4):403-434, 1976. 
J Hofbauer and K Sigmund. Evolutionary Games and Population Dynamics. Cambridge University 

Press, 1998. 
A Melbinger, J Cremer, and E Frey. Evolutionary game theory in growing populations. Phys. Rev. 

Lett, 105:178101, 2010. 



25 



M A Nowak, A Sasaki, C Taylor, and D Fudenberg. Emergence of cooperation and evolutionary 
stability in finite populations. Nature, 428:646-650, 2004. ISSN 0028-0836. 

S Okasha. Evolution and the Levels of Selection. Oxford University Press, Oxford, 2006. 

G R Price. Selection and covariance. Nature, 227:520-521, 1970. 

P F Verhulst. Notice sur la loi que la population pursuit dans son accroissement. Corresp. Math. 
Phys., 10:113-121, 1838. 



26 



